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Abstract 

We extend to the K-SAT and p-XOR-SAT optimization problems the 
results recently achieved, by introducing the concept of Random Multi- 
Overlap Structure, for the Viana-Bray model of diluted mean field spin 
glass. More precisely one can prove a generalized bound and an extended 
variational principle for the free energy per site in the thermodynamic 
limit. Moreover a trial function implementing ultrametric breaking of 
replica symmetry is exhibited. 

Key words and phrases: optimization problems, replica symmetry breaking, 
ultrametric overlap structures. 

1 Introdution 

In the case of non-diluted spin glasses, M. Aizenman R. Sims and S. L. Starr 
(0) introduced the idea of Random Overlap Structure (ROSt) to express in a 
very elegant manner the free energy of the model as the an infimum over a rich 
probability space, to exhibit an optimal structure (the so-called Boltzmann one), 
to write down a general trial function through which one can formulate various 
ansatz's for the free energy of the model. It was also described how to formulate 
in particular the Parisi ansatz within this formalism. In we extended those 
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results to the case of diluted spin glass (Viana-Bray model) . Here we extend the 
same results to optimization problems, the K-SAT and the p-XOR-SAT. The 
latter is the simple extension to p-body interactions of the Viana-Bray model, 
which is the diluted version of the famous model of Sherrington and Kirkpatrick 
of mean field spin glass. Many of the calculations in the present paper are quite 
simple and standard, and as general reference with many details the reader can 
take for instance Pp. 



2 Model, Notations, Definitions 

Consider configurations of Ising spins a : i cji = ±l,z = 1,...A^. Let 
be Poisson random variable of mean ^, and be independent identically dis- 
tributed random variables, uniformly distributed over points {1, . . . , iV}. If { J/f } 
are independent identically distributed copies of a symmetric random variable 
J = ±1, then the Hamiltonian of random K-SAT is 

= - E 2 + '^'^^i) • • • 2^^ + ^"^^^"^ ■ 

Here a > is the degree of connectivity and both p and K are supposed to be 
even. We do not consider the presence of an external field, but all the results 
trivially extends to this case as well. By lo we mean the Bolztmann-Gibbs 
average 

uj{0) = Z^^ E ^(^) exp(-/3i/) , Zjv = E exp(-/3i?) 

We will denote by E the average over all the others (quenched) random variables, 
and the free energy /jv per site and its thermodynamic limit are defined by 

-PJn = ^ElnZw , / = lim Jn 

We will use the notation Q for the product of the needed number of independent 
copies (replicas) of lo and (■) for the composition of an E-type average over 
some quenched variables and some sort of Boltzmann-Gibbs average over the 
spin variables, to be specified each time. The multi-overlaps are defined (using 
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replicas) by 

1 (1) (n) 

i=l 

Definition 1 A Random Multi-Overlap Structure TZ is a triple (S,{(5„},^) 
where 

• T, is a discrete space; 

• ^ : E — > M+ is a system of random weights; 

• qri---r2i ■ ^ [0,1],^ £ N, < 1 is a positive definite Multi-Overlap 
Kernel. 

3 The Structure of the model 

In order to understand what is the underlying structure of the model, it is well 
known that it is useful to compute the derivative of the free energy with respect 
to the somewhat basic parameter. In the case of non-diluted spin glasses such 
parameter the strength of the couplings (and it is equivalent to differentiating 
with respect to the inverse temperature). In the case of diluted spin glasses such 
parameter is the connectivity. 

It is very easy to show (see e.g. Hfl) by pretty standard calculation that 

--Eln^e,exp(-/?i?) = 5:L^ __ ((1 + Q„(g))^) (1) 

7 n>0 ^ ' 

where 

n l,2n 

Q2n{q) — ^ ^ 9ri- r2i , Q2n+1 = . 
1=1 ri<---<r2i 

The fundamental quantities governing the model are therefore the multi-overlap, 
like for diluted spin glasses (jSE]). That is why we use RaMOSt in this context 
as well. The main difference is that here the function 1 -I- Qn takes the place of 
the mere multi-overlaps. 
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As it should be clear from [HI EE]) we must therefore introduce also two 
random variables H^'J, a; J) and i?(7, a; J) such that 

--E Inj: cM-m ^kY: ^..r^ ((1 + QrMY'-') 

7 n>0 ^ ' 

--Eln^ eM-m - {K-l) ^ ((1 + Q„(g))^) 

7 n>0 ^ ' 

Finally, we introduce as expected the following trial function, that we write this 
first time only considering an external field 

= Tr'ii'ln 

where Hi are independent copies of H We will construct explicitly H and H 
in the next sections. Let us define 

N 

'2 



4 Generalized Bound and Extended Variational 
Principle 

Let us state the extension to the K-SAT model of the results presented in [HIE]. 
Consider the interpolating Hamiltonian 

H^{t) = H{t) + H{1 -t) + H{t) 

where t is understood to multiply the connectivity, and 

then it is easy to prove (0)^111) by interpolation the following 
Theorem 1 (Generalized Bound) 

-/?/ < lim inf Gjv . 
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The proof is based on observing that i?(l) = ^P/n, ^(0) = Gn and computing 
the t-derivative of R.{t) using the expressions in the previous section 

n>0 ^ ^ 

((1 + Q2u{q)f - P(l + Q2„(g))(l + Q2n{qyf + iP- + Q2n{q)f) 

where the odd terms are missing since they cancel out. Therefore the derivative 
above is non-positive since the function — pxy^~^ + (p — of a; and y is 
non-negative. 

The Bohzmann RaMOSt TZb(M) is by definition the one for which E = 
{ — 1, 1}*^ and, using t instead of 7, one choses = exp(— /JHa/ (t)) and 

Pa-oN , , , 

P(K-l)aN 

where the independent random variables j' are uniformly distributed over 1, . . . , M 
and J-, J- are independent copies of J. The (limiting) Boltzmann RaMOSt TZb 
fulfills the Reversed Bound (0111) 

-I3f> lim liminf G'A^(7^s(M)) = lim GnCRb) 

which can be proven in the same way as the analogous theorem 3 of 0], except 
here we must chose a' = a(l + {K — 1)N/M). As a consequence, one can state 
the following 

Theorem 2 (Extended Variational Principle) 

—Bf= lim infG/v • 

It is easy to see that the Boltzmann RaMOSt for the K-SAT is factorizcd in the 
sense of section 5 of 0]. 
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5 Replica Symmetry Breaking and Ultrametric 
RaMOSt 

We are about to extend the results of 5 to the K-SAT by constructing the 
Ultrametric RaMOSt TZjj with i?-level Replica Symmetry Breaking. The latter 
corresponds to the choice of ^-y(mi, . . . ,mfl),7 = (71, . . . ,7^^) (illustrated e.g. 
in 12]) derived from the Random Probability Cascades, to be used in the case 
of the K-SAT together with 

H-r ^ X! "2^ - -^lncosh(/3u2;) 

with , iij chosen such that 

tanh(/3w^) = (e-^ -1)1(1 + j^w^)... 1(1 + jK-i^K-i^ 

Unh{f3u^) = (e-P -1)1(1 + j^W^)...^(l + j^W^) 

in which is the same as in the case of diluted p-spin glasses (0) 

Wj = Qai{PK)J-n ^ ^ ^aB{PK)Jli---lR 

where uja(pk^) is the infinite volume limit of the Boltzmann-Gibbs average of a 
random spin from an auxiliary system with a Viana-Bray one-body interaction 
Hamiltonian at connectivity a (:.5 ). The indices, the bar, the tilde, the hat 
mean independent copies of the corresponding variables. Let us now report 
a comment from 4 . Given any partition {a;°}^^o '^^ t^*^ interval [0, 1], there 
exists a sequence {fiaj^^o ^ [Oi °o] such that qi...n{a.a) — Xa ~ Xa-i- In other 
words, a sequence {a.a}a=o ^ [0; 00] generates for each n e N a partition of [0, 1] 
considered as the set of trial values of qi...m provided the da are not too large 

< 1 . (2) 

a<R 

We limit our trial multi-overlaps to belong to partions generated in this way. 
This implies that the points of the generated partitions tend to get closer to 
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zero as n increases. Which is good, since in any probability space decreases 
as n increases and therefore the probabihty integral distribution functions tend 
to grow faster near zero. Now put inductively 

^a.a\' ki, ki, / — Hri---ri\^a J — Hri---ri Hri---ri i Hri---ri ^ 

then an elementary calculation shows that 

Etanh"(/3^^) = (^^F^) (1 + 

Etanh"(/3w^) = (^^IT^) i'^ + Qniq))" 
with q ultrametric (0), i.e. 

9ri---n — Wri-.-n - qri---ri)0^^l...^U + t(qri---ri ^ 9ri •■ -n JfJ^^i . . .^J^i ' ' ' O^^^l ...^U 

If we denote by X the map cia — > satisfying (|2J), we have TZu — Tix,R and 
the trial function is 

inf GiTZxM) ■ 

X,R 

Notice that the Ultrametric RaMOSt for the K-SAT factorizes exactly like the 
Boltzmann one, which is optimal. 



6 Conclusions 

The RaMOSt is the minimal generalization of the ROSt, and what we showed 
here and in |3] is that the minimal generalization is enough to formulate the 
variational principle and also exhibit a concrete RaMOSt analogous to the Parisi 
one for SK. As a consequence, it is enough to restrict the space of trial functions 
to those expressible in terms of fixed multi-overlaps (i.e. a set of numbers, not 
random variables to be averaged). 



A The p-XOR-SAT 

The Hamiltonian of the random p-XOR-SAT coincides with the one of the di- 
luted p-spin glass 

PcN 
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It is therefore elementary to extend all the results of ^ |3] to this case, also 
when in presence of an external field. Since it is easy to show (0]) 

Ai.Eln^^^exp(™/3i7) = ^ i-Etanh2"(/3J)(l - (qfj) 

7 n>0 

the structure of the model is the same RaMOSt valid for the case of the Viana- 
Bray model, but the equality above suggests to try and get the non-negative 
convex function —pxyP^^ + (p— l)y^ whenever we got the square x'^ —2xy + y'^ 
in the Viana-Bray case. 

That is why here H and H are chosen such that 
d 1 



-ElnJ^^-r^M-PH.) = p ^ i-E tanh2"(/3J)(l - (gf-i)) 

7 n>0 

A^Eln^^,exp(~/3H) = (p - 1) J] i-Etanh2"(/3J)(l - (gfj) 

7 n>0 

and plugged in 



The Generalized Bound clearly holds, the Boltzmann RaMOSt is the one with 

PpcN P{p-l)aN 

v=l u=l 

(same couplings as the original system) and it is optimal so that we can also state 
the Extended Variational Principle. The Broken Replica Symmetry Ultrametric 
RaMOSt (which includes as a trivial case the Replica Symmetric one) relies on 
the weights ^-y of the Random Probability Cascades as in 2 and on 

PpaN 



cosh(/3J) 



J2o. 



V/5 cosh(/3Jj) 
H - "v°7li cosh(/3J) j\ 

with 

tanh(/3J^) ^ tanh(/3J)l^i ■ • ■ W^''^ , tanh(/3J^) = tanh(/3J)W'i ■ ■ -W^ 
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where are independet copies of 



Wj{J,k^) =a)5i(pfcJJ^i H \-ivaii{pk,)J- 



71---7-R 



with J = ±1 symmetric. 
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